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(54) Pixel correction system and method for CMOS imagers 



(57) Disclosed is a fault tolerant CMOS image sen- 
sor that includes circuitry for identifying defective pixels 
and masxing them during image generation. Masking 
mny involve, in one example, replacing the output of n 
given pixel wi : .h an average of the output ol surrounding 
non-faulty pixels. Thus, while image sensors may be 
labricated with some number of faulty pixels, the images 
produced by such sensors will not have undesirable 
oright or dark spots. The disclosed sensor includes (a) 
one or more pixels (active or passive) capable of pro- 



viding outputs indicative of a quantity of radiation to 
which each of the one or more pixels has been exposed; 
and (b) ono or more circuit elements Gloctrically coupled 
lo the one or more pixels and configured to iderlify and 
correct faulty pixels in the CMOS imager. The one more 
pixels each include a photodiode diffusion formed in a 
well and a tap to power or ground also formed in the 
woll. The disclosed sensor also identities pixels that 
were initially acceptable but later became defeciivo. The 
newly defective pixels so identified may then be masked 
to thereby increase the CMOS detector lifetime. 
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Description 

[0001] The present invention relates lo an integrated 
circuit arcnitec'.ure for CMOS imagers. More specifical- 
ly. r .he present invention relates to methods and appa- 
ratus for masking or correcting faults in individual pixels 
ot CMOS inrvicjcrs. 

[0002] CMCS image sensors are now becoming com- 
petitive with charge coupled device ("CCD*) array image 
sensors. Potential applications include digital cameras, 
night time driving displays for automobiles, and compu- 
ter peripherals tor document capturo and visual commu- 
nications 

[0003] Since the 1 970s, CCD arrays have dominated 
the electronic image sensor market. They have outper- 
formed CMOS array sensors in most areas, including 
quantum efficiency, optical fill factor (the fraction of a pix- 
el used lot detection), charge transfer efficiency, read- 
out fate, readout noise, and dynamic range. However, 
the steady improvement in CMOS technology (including 
increasingly small device size) has moved CMOS image 
sensors into a competitive posture. Further, in compar- 
ison lo CCD technology. CMOS technology provides 
lower power consumption, increased functionality, and 
potentially lower cost. Researchers now envision single 
chip CMOS Ciimeras having (a) integrated timing and 
control electronics, (b) a sensor array, (c) signal 
processing electronics, (d) an analog-to-digital convert- 
er and (e) interface electronics. See Fossum, "CMOS 
Image Sensors: Electronic Camera On A Chip." 1995 
IEDM Technical Digest, Wash. DC, Dec. 10-13, 1995, 
pp 17-25 whrh is incorporated herein by reference for 
nil purposes. 

[0004] CCD arrays are limited in that all image data is 
read by shifting analog charge packets from the CCD 
array interior to the periphery in a pixel-by-pixel manner. 
Unfortunately Ihe pixels of the CCD array are not ran- 
domly addressable. In addition, duo to voltage, capaci- 
tance, and process constraints, CCD arrays are not well 
suited to integration at the level possible in CMOS inte- 
grated circuits. Hence : any supplemental processing 
circuitry required for CCD sensors (e.g., memory for 
storing inform; jtion related to the sensor) must generally 
bo provided on soparalc chips. This, of course, increas- 
es the system s cost. 

[0005] A persistent problem of both CMOS and CCD 
image sensor technologies is image degradation due to 
faulty pixols. Such faulty pixels arise from processing 
variations inherent in fabrication of numerous sensor 
chips. A pixels fault may be manifested by an output 
indicative of a radiation exposure that does not accu- 
rately reflect the actual radiation exposure to which the 
pixel was exposed. For example, a pixel thai outputs 
more charge than is expected upon exposure loa par- 
ticular amount of radiation appears as a bright spot in 
an image. Similarly, a pixel that outputs less charge than 
expected appears as a dark spot. 
[0006] Typir ;i1y : image sensors are tested after 1abri- 
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cation to identify the number ol faulty pixels that they 
contain. If any sensor has more than a specified number 
of faulty pixels : it must be rejected. Thus, sensor yield 
is limited by the number of faulty pixels typically pro- 

s djced on a chip. Not surprisingly, wide area sensors 
having large numbers of pixels have relatively low yields 
because they tend to have higher numbers of faulty pix 
els (Ihe number of faulty pixels per total number cl pixels 
is, approximately constant for a given fabrication tcch- 

io nology). 

[0007] While careful screening of image sensors after 
fabrication can locate defective arrays, it cannot prevent 
sensors from degrading during normal use. Pixels 
sumetimes develop such faults during normal operation. 
Unfortunately, no effective mechanism exists tor identi- 
fying and correcting such faults. 
[0008] What is needed therefore is an improved im- 
age sensor that can mask or otherwise correct detective 
p.xels soon after the sensor is fabricated and during its 
lifetime. 

[0009] The present invention provides a fault tolerant 
radiation imager such as a CMOS imager. Such image 
sensor includes circuitry for masking and/or correcting 
defective pixels during image generation. Masking may 
involve, in one example, replacing the output ot a given 
pixel with an average of the outputs of surrounding ncn- 
f.-iufty pixels. Correction may involve increasing or de- 
creasing the output level from a pixel to be corrected. 
T*ius ; while image sensors may be fabricated with some 
number ot laulty pixels, the images produced by such 
sensors will be superior to those produced by sensors 
that do not have such masking or correcting mecha- 
nisms. Fuithor, sensor yield may bo improved because 
even those sensors having more than Ihe additionally 
allotted number of detects may be used (so long a?, the 
defective pixels are appropriately masked or correctec). 
In one preferred embodiment, pixels that were initially 
good and later become defective may bo identified r;t 
the lime they become defective. The nuwly defective 
pixels so identified may then be masked or corrected as 
described to thereby increase the CMOS detector lite- 
time. 

[0010] One aspect of 1he present invention provides 
a method of masking faulty pixels that may bo charac- 
terized by the following steps: (a) exposing an imager 
to radiation; (b) identifying a faulty pixel in the imager: 
(c) determining outputs o1 a plurality of other pixels lo- 
cated about the faulty pixel; and (d) masking an ottput 
ol the faulty pixel using the outputs of the plurality of 
other pixels. Then a masked output of ttie faulty pixel 
can be provided in an image produced by the imager. 
Preferably, the system identifies the laulty pixel by ac- 
cessing memory associated with the imager to deter- 
mine the location of the faulty pixel in the imager. Then 
to generate an image corrected for Ihe faulty pixel, the 
method may also require conversion of the output of the 
pixels (including the masked output) from an analog for- 
mat to a digital format prior to masking the pixel's output 
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[0011] In one embodiment masking the output of a 
faulty pixel involvos replacing its output with an output 
value based exclusively on the output of multiple sur- 
rounding pixels. For example, the corrected output may 
be obtained by interpolating output values of at least two 
pixels surrounding the at least one faulty pixel. In color 
imagers, tho pixels ol the imager can discriminate be- 
tween multiple colors and the faulty pixel therefore will 
be designated to detect radiation of a single color. Pref- 
erably, in such cases, the plurality of other pixels chosen 
to mask the output of the faulty pixel are only those sur- 
rounding pixcb that arc designated to detect radiation 
of the same color as the faulty pixel. 
[001 2] It may not be necessary to totally mask the out- 
out of each of the faulty ptxels. For example, some pixels 
may not be completely corrupted, in which case their 
outputs could bo corroctod rathor than masked. In ono 
instance, tne foully pixel may be known lo have an out- 
put that is 20°o lower than appropriate. Thus, the output 
of that pixel may simply be increased by 25% belore pro- 
ducing the image. 

[0013] Of course, some technique for identifying 
faulty pixels must be conducted initially (when the imag- 
er is produced) or periodically over its lifetime. In one 
embodiment, the system electronically tests a selected 
pixel according to the following sequence: (i) electroni- 
cally resetting the selected pixel to a defined charge (e. 
g. ( the charge associated with a dark value in an image); 
(ii) reading the selected pixel's output; and (iii) compar- 
ing the selected pixel's output to an expected value 
based upon the defined charge provided to the selected 
pixel. If the selected pixel's output significantly deviates 
from the expected value, the system designates the se- 
lected pixel ab faulty. Alternatively, the conducted Lest 
may also be an optical test in which the imager is ex- 
posed to radiation of a known intensity lor a known du- 
ration. The outputs of the pixels are then compared to 
expected values as described abovo 
[0014] In the case of an electronic test and where the 
selected pixel includes an n-well and a p-diffusion pho- 
todiode, electronically resetting the selected pixel re- 
quires injecting a quantity of negative charge into the p- 
diffusion. In phctodiodes of the opposite conductivity 
type, negative charge is removed from an n-typo diffu- 
sion during reset. 

[001 5] I he test results may be interpreted as follows: 
if the selectee) pixel's output significantly deviates from 
the expected value, tho system determines whether the 
selected pixel is partially or completely corrupted. 
Thereafter, masking or correcting the output of the se- 
lected pixel enoloys a first technique for a partially cor- 
rupted pixel and a second technique for a completely 
corrupted pixel Because the second technique involves 
a completely corrupted pixel, littlo if any information from 
the oulpul of Ihe pixel may be used. Thus, the second 
masking technique may involve interpolation or other- 
wise averaging the outputs of pixels surrounding the 
completely corrupted pixel. The first technique may in- 



volve using the output from the pixel -- simply increasing 
or decreasing that output by a fixed percentage or mag- 
nitude. 

[001 S] To automatically recall the faulty pixel identities 

s p'ior to image generation, the test method may be con- 
cluded by storing the location of the one or more faulty 
pixols in a memory. In appropriate instances, it may also 
involve storing data specifying whether each of the one 
or more faulty pixels is partially or completely corrupted. 

io [0017] Another aspect of the invention provides an im- 
ager that may be characterized as including the follow- 
ing olemonts: (a) one or more pixels capable of provid- 
ing outputs indicative of a quantity or a type or bolh Ihe 
quantity and type of radiation to which each of the one 

15 cr more pixels has been exposed; (b) one or more circuit 
e ements electrically coupled to the one or more pixels 
nr.d configured to mask or correct faulty pixels in tho im- 
ager; and (c) a memory configured to store the locations 
ol the faulty pixels. Preferably, these various elements 

20 are provided on a single integrated circuit chip. 

[0018] The imager may also include one or more volt- 
age sources capable of delivering a voltage lo the phc- 
iodiodo diffusions of Iho ono or more pixels (typically to 
reset the pixels' states). II may further include one or 

25 more charge integrators capable ol measuring the pixel 
ojtputs. S1ill further it may include an analog-to-digital 
converter capable of receiving analog outputs from the 
one or more pixels, converting the analog outputs to dig- 
ital signals, and providing the digital signals to the one 

30 or more circuit elements such that the one or more circuit 
elements can identify faulty pixels. In an especially pre- 
ferred embodiment, the plurality of pixels is arranged in 
an array such that each of the pixels in the plurality of 
pixels is separately addressable. 

35 [0019] In many CMOS imagers, the one more pixels 
will each include a photodiode diffusion formed in a well 
and a tap to power or ground also formed in the well. 
Siich pixels may be of an active or passive design 
[0020] Another aspect of thB invention prov-dos; a sys- 

40 torn for producing an image of an object. This system 
ncludes an imager of the type described above and one 
or more components tor outputting an image resulting 
from the outputs of the one or more pixels The image 
may bo a photograph in tho case of a digital camera for 

45 example 

[0021] These and other features and advantages of 
the invention will be described below in Ihe Detailed De- 
scription section with roforenco to the appended draw- 
ings. 

so [0022] Figure 1 is a block diagram illustrating high lov- 
ei lunctional blocks employed in a CMOS imager imple- 
menting the fault tolerant imager of the present inven- 
tion 

[0023] Ftguro 2A is a cross-sectional diagram ol h 
passive photodiode pixel, of a type suitable for use with 
the CMOS imager of Figure 1, being reset. 
[0024] Figure 2B presents the same cross-sectional 
riagram presented in Figure 2A. but showing how the 
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reset charge on the pixel is read out to determine it the 
pixel is faulty 

[0025] Figure 3A is a hypothetical graph illustrating 
how the system may categorize pixels as partially or 
completely cor rupted due to a leaky diode in accordance 
with one embnriiment ot this invention. 
[0026] Figure 3B is a hypothetical graph illustrating 
how the system may categorize pixels as partially or 
completely corrupted due to an obstruction or gain mis- 
match in accc rdance with one embodiment of this in- 
vention. 

[0027] Figure 4A is a process flow diagram illustrating 
a method by wnich the pixels ol an array may be tested 
to detenrvne v. h ether they are corrupted. 
[0028] F igur o 4B is a process flow diagram illustrating 
how corrupleci oixels are treated during image genera- 
tion in accordance with one embodiment of this inven- 
tion. 

[0029] Figuio AO is a p-ocess flow diagram detailing 
one technique by which corrupted pixels may have their 
outputs masked or corrected to generate a clear image. 
[0030] Figure 5 is an illustration of the pixel arrange- 
ment in a coloi imager, presented to illustrate how pixel 
conection can be conducted in color imagers. 
[0031] The invention will be described with reference 
to certain prei-irred embodiments set forth below. Spe- 
cifically, the invention will be described with reference 
to a particular CMOS sensor employing depletion mode 
photodiodes. Ii should be understood that the invention 
is in no way specifically limited to these embodiments. 
For example, the methods and systems described here- 
in may be proiitably applied to photogate arrays, CCD 
arrays and virually any otner typo of radiation imaging 
auay. Further, while the CMOS pholodiode array design 
presented her jin is a "passive" design, the principles of 
this invention can be applied to other designs such as 
active pixel dr signs. 

[0032] Rguro 1 prosonts ono preferred systom archi- 
tects e for implementing a CMOS imagor in accordance 
with this ^nverv.'on Preferably all elements of the depict- 
ed systerrrare implemented on a single integrated circuit 
chin. The tigme presents an imager 10 including four 
orimary elements' a pixel array area sensor 12, an an- 
alog-lo-digilal converter 13. a fault analysis and correc- 
tion block 24, . nid a memc y 26 for stoiing fault and cor- 
rection data. 

[0033] Area senscr 1 2 ircluries a plurality of regularly 
arranged pixclr, each capable of rospondingto radiation 
impinging on the sensor. Often, as in the case of most 
diyital cameras, the radiation will be visible electromag- 
netic radiation. Detection of other types of radiation is 
within the purview of this invention. Each pixel produces 
an output indi.^itive of the radiation intensity over lime 
(integral of intensity with lime) sinking the pixol. In ono 
specific embodiment, ar ea sensor 112 includes an array 
ol 1024 (verticil direction) by 1024 (horizontal direction) 
pixels, but ot course the actual array dimensions will de- 
pend upon inn application and the scale of the IC fnbri- 
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cation technology In operation, an optical image may 
bo directed onto area sensor 12 such that spatial and/ 
oi temporal variations in light intensity (or some olhei 
radiation lealure such as wavelength) may be tempo- 
s rarity recorded by the individual pixels making up sensor 
1?. 

[0034] The signals from the individual pixels of sensor 
12 are output over one or more lines 14 as analog sig- 
nals 1G. These analog signals 16 are received by ana- 

to Icg-lo-digital converter 1 B which converts them to digital 
signals 2? and outputs such digital signals overa line 20. 
[0035] Digital signals 22 arc then received by the fault 
analysis and correction block 24 which communicates 
with memory 26 over a memory connection 23 (e.g.. a 

J5 bus) in orcer to appropriately mask the output o* 'aulty 
pixels in area sensor 12. Fault analysis ano correction 
block 24 thereby produces a corrected sot of output pix- 
els which il sends over a line 30 to image display cucuil- 
ry. 

20 [0036] While the individual elements ot system 10 
may be implemented on different physical structures, ar- 
r."j sensor 12 ; analog-lo-digital converter 18. and fault 
analysis/correction block 24 are preferably provided on 
a single integrated circuit chip. In addition, it may be de- 
2$ sirable to include memory 26 on the same chip. Memory 
26 should be made as small as possible yel large 
enough to More all necessary information for correction/ 
masking of each faulty pixel. As most sensors can be 
expected to have only a few faulty pixels, memory 26 
so typically need not be very large. Its size will largely de- 
pend upon the size of the pixel array itself. Typically, it 
can be expected that no more than 0 1% of the pixels 
will ever be faulty in a functional imager. One might ex- 
pect no more than two or three bytes need be set aside 
35 for storing the location and correction information asso- 
ciated with each defective pixel. Based on this logic, 
memory 26 may typically be between about 10 kilobits 
and 1 Megabit. Further, memory 26 may take many 
forms such as SRAM. ROM (EEPROM, flash memory, 
40 or EPROM). DRAM, etc. 

[0037] One of the most significant benefits of CMOS- 
b*sed image sensors is their easy integration wilh on- 
chip analog-to-digital converters. Preferably the an;j- 
Icg- to-digital converter will consume little power and oc- 
45 cupy little rirea. yet meet the pixel processing iaty at the 
resolution required of the system's application. It is pos- 
sible to have a single analog-to-digital converter for the 
entire array (operating at the pixel rate), n single con- 
verter for oach pixel (operating at the frame rale), a con- 
50 verier for each column of the array (operating at the line 
rate), or some other division of labor. 
[0038] Figures 2 A and 2B present side sectional 
views of a single passive pixel. In Figure 2A : the pixel is 
boing reset for lasting, and in Figuro 2B, the pixel's uc- 
ss cumulated charge is measured to determine whether 
ti e pixel has been corrupted. Figure 2B also illustrates 
the state of a pixel when its output is being read for nor- 
mal imaging. 
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[0039] As dnpicted in Figures 2A and 28, a pixel 200 
is formed cn semiconductor substrate 202. An n-woll 
204 is formec as a layer Ofi Iho upper pari of substrate 
202, which m;»y be an epitaxial iayer for example. In a 
preferred embodiment, well 204 spans multiple pixels in 
a two-dimensional array. However, it is within the scope 
of this invention to have a separate well for each pixel. 
Within each pixel, a p-type photodiode diffusion 206 is 
provided to store charge upon exposure to radiation. In 
addition, each pixel 200 includes a substrate tap 203 for 
holding the wrII 204 at a fixed voltage such as V dd . Sub- 
strate tap 206 may bo a highly doped n-type region for 
providing a low resistance ohmic contact to well 204. 
Substrate lap 206 connects to an appropriate power 
source via an appropriate contact or interconnect. 
[0040] Various optical layers/elements maybe provid- 
ed on pixel 200 -- at least on diffusion 206. To simplify 
the diagrams these additional elements are not shown 
in Figures 2A ^nd 2B. These optical elements may in- 
clude, for example, a lens for optical collection of pho- 
tons and filters lor wavelength discrimination of photons 
(as used in color pixels). 

[0041] It should be understood that while pixel 200 is 
depicted as hnving an n-type well and a p-type photodi- 
ode diffusion, '.he invenlion is not limited to this arrange- 
ment. Thus, well 204 could be a p-type region and dif- 
fusion 205 could be an n-type region. In either case, the 
concentration of dopani alorns in regions 204 and 206 
should be cfu-seri to create a depletion mode photodi- 
ode. In such photodiodes. radiation impinging on pho- 
todiode diffusion 206 causes generation of holes and 
electrons in trv; depletion region. Because the depletion 
region docs not contain free charge carriers, these new- 
ly created holes and electrons are not immediately an- 
nihilated by combination with carriers of the opposite 
charge. Elections drilt to well 204 and holes drift to p- 
diffusion 206 where they are collected as free charge 
on<^£) capacitor C pw 207 defined at tho p-n junction 
between the photodiode diffusion 206 and the well 204. 
The capacitance of C pw is sometimes referred to as the 
photodiode 's "intrinsic capacitance." 
[0042] Durinrj normal operation, pixel 200 is exposed 
to a source of radiation for a defined period of time. The 
flux of radiation (intensity) integrated over tho length of 
the exposure time define an "integrated illumination" 
which is related to the amount of charge that builds up 
on the capacil nr defined by the p-n junction of diffusion 
206 and well ?04 To "road" pixel 200, photodiode 206 
is discharged uo that tho amount of stored charge can 
be determined. This charge specifies the integrated il- 
lumination which can be converted to an average radi- 
ation intensity based upor the known exposure time. 
The outputs ni all pixels in the array are used to create 
h radialion intensity distribution or imago. 
[0043] In the illustrated embodiment, the pixel output 
is coupled to .i cnarge integrator 210 by a connection 
line 212 and transistor 214. While photodiode 206 is 
exposed to radiation, irannislor 214 is switched off so 



that the charge accumulates in pixel 200. When pixel 
200 is to be read, transistor 214 switches on so that tho 
charge accumulated in photodiode diffusion 206 can 
flow over connection line 212 to charge inlegrator 210 
s and a capacitor 222 (connected in parallel witn amplifier 
2 10), Charge integrator 210 then measures :he voltage 
across capacitor 222 and generates an output corre- 
sponding lo the quantity of charge received from photo- 
diode 206. Nole that a switch 225 provided in parallel 
JO with capacitor 222 should be switched off during the 
road proenss so that a potential difference can be es- 
tablished across the plates of capacitor 222. 
[0044] Concurrently with this reading process, photo- 
diode 206 is "reset" to a "dark" state in which it is largely 
'5 depleted ot excess charge. In one example, in which V dd 
is 5V, photodiode diffusion 206 is reset to 1V which is 
tho dark stato (i.e., tho voltage associated with no radi- 
ation being sensed by pixel 200). During rebel, switch 
225 is closed so that the reset voltage (tho output of 

no charge integrator 210) can be applied to line 212 and 
hence photodiode diffusion 206. 
[0045] Fault analysis and correction block 24 may 
electronically determine if a given pixel is a faulty pixel. 
It may do this in various manners. For example, aftei a 

2S pixel is reset, that pixel may be sampled at a later time 
to determine whether its voltage has deviated from that 
ol a dark state. Remember that on reset, a pixel photo- 
diode is discharged such that the pixel assumes a volt- 
age associated with the dark state (e.g.. about 1 V). If. 

w uoon sampling the reset pixel, it is found that the pixel 
voltage deviates from that associated wi:h this dark 
state, the pixel may be deemed faulty by fault analysis 
and correction block 24. In this case, tho output ol that 
pixel is collected or masked during subsequent images. 

3$ [0046] Hetuming to Figure 2A, the reset mechanism 
for testing pixels is depicted. While pixel 200 is not ex- 
posed to light, charge integrator 210 discharges photo- 
d ode diffusion 206 over line 212 to the reset voltage V r 
Note that this requires switching transistor 214 on. The 

40 pocel is then disconnected from charge integrator 210 
by turning off transistor 214 and photodiode 206 is al- 
lowed to remain idle for a fixed length of lime. The 
charge on photodiode diffusion 206 is then rend out 
through charge integrator 210 by again closing switch 

4 $ 214 (Figuie 2B). The associated detection circuitry then 
determines whether pixel 200 is corrupted. 
[0047] This technique will determine whether charge 
leaks between the photodiode diffusion 205 and well 
204. If posilive charge leaks into the dillusion (in the 

so ciise of a p-type diffusion and n-type well), tne pixel is 
found to be faulty during the above test. If uncorrected, 
the faulty pixel will appear as a "white pixel* (i.e.. it will 
appear inappropriately bright). 

[0048] This is not tho only type ol pixel defect of rele- 
ts vmice here. Sometimes a pixel will bo partially oi com- 
pletely blocked as by a dust particle remaining Irom fab- 
rication. It is also possible that new particles will block 
the pixel during the CMOS imager's operating lifetime 
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Also, the optical elements on a pixel (lens, filter, etc.) 
may degrade and obstruct radiation. These types ol fail- 
uies result in "dark pixels" (i.e.. Ihe pixel appears inap- 
propriately daik in an image). Unfortunately, obstruction 
type defects can not be tested without providing light to 
the army. Thu;. an optical test must be employed, var- 
ious optical to.;ts arc known in the art and employed be- 
fore CMOS imagers are shipped. Such tests usually in- 
volve resetting the pixels as described above, exposing 
pixels 1o known quantities ot radiation and then reading 
their outputs. Variations ol such tests may be employed 
to periodically test the imager over the course of its life. 
If any pixel so tested, outputs less charge than expect- 
ed, the pixel h deemed faulty and must be corrected. 
[0049] Slill another type ot pixel fault results from var- 
ious intrinsic (infects in the photodiode itself. These may 
result because the radiation collection region of the pixel 
is laiger or simllerthan desired (i.e.. the photodiode dif- 
fusion size does not meet specifications), the dopant 
concentration in the photodiode deviates from a desired 
value, radial on reflects off metal proximate the pixel, 
etc. Each of those gain mismatch faults results in an er- 
roneous pixel tcading. II they cause excess cfiaryc to 
accumulate <r the photodiode, they result in white pixels, 
and if they cause too little charge to accumulate in the 
pnotodiode, they result in dark pixels. Optical tests, as 
described above, may be employed to test for and clas- 
sify such gain mismatches. 

[0050] Reyaidloss of the type of testing employed 
(optical or electronic), fault analysis and correction block 
24 may operate in various manners. In one embodi- 
ment, block 24 merely determines whether a given pixel 
is faulty or not. In a more sophisticated version, block 
24 not only deiurmines whether a pixel is faulty, but what 
type ot fault it harbors and just how faulty it actually hap- 
pens to be. r or example m one embodiment., the sys- 
tem dftterminr.s whether a given pixel is working correct- 
ly, is partially c orrupted (while or dark), or is completely 
corrupted. It may make this determination depending 
upon how far Ihe expected pixel intensity (photodiode 
voyage) deviates from an expected value. 
[0051] This embodiment is depicted graphically in 
Figures 3A anrJ 3B. The vertical axes represent the pixel 
output voltage as output by charge integrator 210. Nolo 
that, in the case of a p-type photodiode diffusions, the 
greater the a-nount of illumination striking a pixel, the 
lower the voiu.rje output by charge integrator 21 0. Con- 
versely, lower amounts of illumination result in higher 
output voltages at charge integrator 210. The opposite 
is true for n-tyL>e photodiode diffusions. In Figure 3A, the 
classes ol pixel output encountered in a "dark test* are 
depicted. In the test the pixels are reset and held in the 
dark for a defined period ol time before their outputs are 
read. In Figure 3B, the classes of pixel oulpul encoun- 
tered in an oplical lest are depicted. In this lest, the pix- 
els are reset *nd then exposed to a defined quantity of 
illumination a defined period of time before their out- 
puts are read 



[0052] In either case, the test begins with pixel 200 is 
reset via transistor 214 to an expected value 302 indi- 
cated in Figure 3. If the measured output at charge in- 
tegrator 210 falls within a correct working zone 304 the 
s pixel is deemed correctly working. In the case of the dark 
test depicted in Figure 3A, if the measured pixel intensity 
(voltage) falls bo low working zone 304. the pixel is 
deemed corrupted. The only question remaining is 
whether the pixel is 'partially corrupted ." in wnich case 
to j(s output may be used in a modified fashion, or "com- 
pletely corrupted,' in which case its output can not be 
used under any circumstances. If the test pixel's output 
falls within within a partially corrupt zone 308. ihe pixel 
is deemed partially corrupted and treated accordingly. 
i5 A pixel voltage lying below partially corrupted lower 
zone 306 is in a completely corrupted lower zone 312 
and that pixel is deemed to be completely corrupted and 
tieated accordingly. 

[0053] Turning now to Figure 3B, if the optical test 
shows that the test pixel's output voltage is above work- 
ing zone 304, the pixel is obstructed or otherwise subject 
to a gain mismatch. If the output votlage is only slightly 
elevated from working zone 304 and lies in a zone 314. 
ti e pixel is deemed partially corrupted. If the ouiput volt- 
age is significantly elevated and lies in a zone 316, the 
pixel is deemed completely corrupted. In some cases, 
the optical lest may reveal that the output voltage is low- 
ei than expected, in which case the pixel is not obstruct- 
ed but is instead subject to a gain mismatch. Such gain 
mismatch mighl result from an oversized light collection 
surface on the pixel. In any event : such gain mismatch 
rnsults in a partially or completely corrupted pixel de- 
pending upon the magnitude of the mismatch. 
[0054] As will be explained in more detail below, par- 
tially corrupted pixels may be treated differently tiom 
completely corrupted pixels. I n the simpler embccimen t. 
pixels are never treated as partially corrupted, they are 
cither working correctly or completely corrupted. 
[0055] As suggested above, the output of charge in- 
tegrator 210 will be an analog signal indicating the inte- 
grated illumination of a currently analyzed pixel. In order 
to easily analyze this signal and make any necessary 
corrections, the analog signal should first be converted 
to a digital signal. This is accomplished with analog-lo- 
d gital converter 1 B as mentioned above. Preferably, an- 
a og-to-digital converter 13 is formed on the same cn;p 
with pixel array 1 2. 

[0056] F;gurc 4A provides a process flow chart of n 
generic method 500 that may bo employed to lest pixels 
tu determine if they are faulty. The flow chart appl.es to 
both optical and non-optical tests. The process 500 be- 
gins at 501 and in a step 502, the photodiodes in an 
*;rmy are charged to a reset voltage, V f . As mentioned, 
this voltage corresponds to the stale of tnc pixel when 
no radiation has slruck il. 

[0057] Next, at a step 503, a decision is made as to 
whether the test is an optical or non-optical lest, it it is 
ri i optical lest, the pixel array is exposed to a defined 
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quantity of radiation at a step 504. Thereafter process 
control is directed to a step 506 (described below). If the 
lest to be conducted is a non-optical step, no radiation 
is provided. In that case, a dark current test is being con- 
ducted and iho next step (step 505) delays reading the 5 
pixels for denned length of time that preferably corre- 
sponds aporoximntoly to :ho exposure time of iho pixels 
while in use. 

[0058] At this point, the process continues a step 506, 
where fault analysis and correction block 24 selects a 
first pixel to be evaluated. Evaluation involves assessing 
the output vol: igc of that pixel at a step 508. Thereafter, 
at a step 510 analog-to-digilal converter 18 converts 
the analog value for that output voltage to a digital value. 
Rom this digital value, logic block 24 determines wheth- 
er the pixel ha? an actual output voltage significantly de- 
viating from an expected output voltage. Sec stop 512. 
Next, logic blojk 24 may optionally determine if the pixel 
is partially or completely corrupted based upon any de- 
viation from the expected output voltage. See step 51 4. 
Block 24 may also classify Ihe corruption according to 
the classifications presented in Figures 3A and 38 
[0059] Assuming that the system determines that the 
pixel is at least partially corrupted, it stores the location 
ot the corrupted pixel and ;he type of corruption (partial 
or complete) in memory 23. This is accomplished at a 
slep 516. If the pixel is partially corrupted, the system 
may also sloro some information about the type and de- 
gree of coriuplion. As explained in more detail below, 
this information is used to correct the partially corrupted 
pixel during readout. After the information associated 
with the corrupted pixel has been stored, block 24 de- 
termines whether the pixel under consideration is the 
last pixel in tlu; array at a slep 518. if so. the process is 
then completed at 526. 

[0060] If dec ision step 5 1 3 is answered in the negative 
(i.e., the current pixel is not the last pixel in the array), 
the system moves to the next pixel in the array at a step 
522. After In; it. process control returns lo step 508 
where the sy&:om accesses the output voltage ol the 
new current p>xel in the array 

[0061] Note that if decision step 514 is answered in 
the negative (i e., The pixel under consideration is not 
corrupted), process control is diroctod lo decision stop 
51 8 wheie the system determines whether the pixel un- 
der consideration is intact the last pixel in the array. 
[0062] Figui n 4B presents a process flow diagram of 
ono method 5/i0 for masking faulty pixels during gener- 
ation of an im-'igc. The process 530 begins at 532 and 
in a piocess tup 534 exposes the pixels ol the array to 
a radiation pattern defining an image. This charges the 
individual phctodiodesof the individual pixels and there- 
by temporarily records the image. Next, at a process 
step 536. tho :;yslcm specifics a current pixel for anal- 
ysis and accesses mernoiy 26 for information concern- 
ing that pixel. From the information stored in memory, 
fault correction block 24 determines whetherlhe current 
pixel is corrupted nt n decision step 536. 



[0063] Assuming that the current pixel is not corrupt- 
ed, the system reads tho output voltage of the pixel at 
h step 540. Thereafter, that output voltage is converted 
to a display value (possibly after conversion from an an- 
alog formal to a digital format) and added to a currently 
generated image. This is accomplished nt a slep 542 
[0064J Tho systom may then deform in o whether the 
current pixel output provides information sufficient lo al- 
low correction of another pixel at a decision step 544. 
As will be described below, some masking and correct- 
ing techniques for defective pixels require output infor- 
mation from adjacent (cr nearby) uncorruptcd pixels. 
Thus, if the pixel under consideration is adjacent to (cr 
at least nearby) a corrupted pixel, the output information 
oi the current pixel may be employed to allow masking 
of the corrupted pixel. Assuming that this is Ihe case fi 
o decision stop 544 is answered in the affirmative), tho 
system calculates a mask value for the previously cor- 
rupted pixel at a step 546. Thereafter, the system ap- 
plies that mask value to the image at the location of the 
corrupted pixel. This is accomplished at a step 548 
[0065] Returning to decision step 536, if it is answered 
v the affirmative (i.e., the current p.xcl is corrupted), tho 
system next determines whether there is sufficient infor- 
mation available to mask or correct the current pixel. 
This is accomplished at a decision step 550. If there is 
sufficient information available to mask the current pixel 
(e.g., the output values of enough uncorruptcd sur- 
rounding pixels are already known), the system calcu- 
lates the mask value 1or that pixel at a step 552. There- 
after, it applies the mask value to the image being gen- 
erated at a step 554 (i.e., it replaces the output of the 
corrupted pixel with a corrected or mask value). If deci- 
sion step 550 is answered in the nugalivo (i.e.. Ihufe is 
insufficient information to mask the current pixel), the 
system flags the current pixel as requiring a mask value 
when sufficient information is available from nnaroy pix- 
els. This is accomplished at a process step 556. 
[0066] Alter either process step 554 o* 556, tha sys- 
tem determines whether the current pixel is the last pixel 
to be considered in the array or an appropriate subsec- 
tion of the array. This is accomplished at a decision step 
558. Note that process control is also directed to deci- 
sion slop 558 after process slep 546. Still further, pioc 
ess control is directed to decision step 556 if decision 
slep 544 is answered in the negative. 
[0067] In any event, assuming that the current pixel is 
not tho last pixel in the array (i.o. f decision slop 558 is 
answered in tho negative), the system moves lo iho next 
pixel in the array for evaluation at a step 560. Process 
control is then redirected to step 536 where memory 26 
s accessed for information about the new current pixel. 
Thereafter the process proceeds as described above 
[0066] Assuming thai Iho syslem determines at deci- 
sion slep 558 lhal Ihe current pixel is in fact the lasl pixel 
in the array, it then completes the image and makes that 
image available lor output (in the case of a full image cr 
frame buffer). Alternatively, if the system employs a iine 
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buffer or some other buffer that holds less than an entire 
imago, decision step 558 determines whether the cur- 
ien1 pixel is lh*i last pixel in a line. If so, the line is made 
available fcr ou'.put. Regardless of the buffer details, the 
appropriate pixels (line, frame, etc.) are output at a proc- 
ess step 562. The process is Ihen completed at 564. 
[0069] A generic process by which a pixel is corrected 
Hi step 552 {or 546) is detailed in Figure AC. The process 
begins at 570 and then in n decision step 572. the sys- 
tem determines whether the current pixel is completely 
corrupted Such information should be available from 
memory 26 and obtained during stop 536 (Figure 4B). 
[0070] Assuming that the current pixel is deemed to 
be completely corrupted, the system generates a cor- 
rected output value for that pixel at a process step 574. 
Note that n the embodiment depicted in Figures 3A and 
3B. a completely corrupted pixol would lie in one of rang- 
es 312 and 315. In the embodiment depicted in Figure 
AC. the system may generate the corrected output value 
by interpotatinq output values of surrounding pixels (as- 
suming these output values are available). It all of the 
surrounding pixels have not yet been evaluated, the final 
interpolated correction for the pixel at hand must await 
output values o1 the adjacent uncorrupted pixels. After 
step 574 is complete, the process is finished at 576. 
[0071] In the case of a color imager, the masking op- 
eration must be cognizant of the color of the pixel that 
is being corrected. Figure 5 illuslralcs the layout of a 
conventional primary color pixel array (red, green, and 
blue). It should be understood that the invention may be 
practiced with other color pixel arrays such as those em- 
ploying complementary color filters. In the embodiment 
of Figure 5. giocn pixels are labeled 'G," red pixels arc 
labeled "R." ar.u blue pixe : s are labeled "B." If the pixel 
deemed completely corrupted is green, then only green 
pixels should be chosen to provide the mask. The same 
nolds true loi red ano blue pixels. Since the nearest 
neighbor pixels to faulty pixel will not bo green, the next 
closest green pixels should be chosen for the mask. 
These may provided on the same line as the defective 
pixe; and/or aujacent lines. In a very precise (but com- 
putationally expensive) operation, not only nearest 
neighbors but the next nearest neighbor pixels are em- 
ployed to make the correction. 
[0072] Assuming that the current pixel is deemed to 
be partially corrupted (i.e.. decision step 572 is an- 
swered in the negative), the system next determines 
whetner the pixel is saturated at a decision step 575. 
This means that Iho output of tho pixol is now maximal 
and any furthoi illumination will not increase the amount 
of charge stored in Ihe diffusion. Thus, it is impossible 
to know hew much radiation actually illuminated the pix- 
el during exposure. Because of this ; tne output is unus- 
able and the system musi resort lo masking the pixel 
with (he outputs of other (surrounding) pixels. Hence, 
the saturated partially corrupted pixel is treated like a 
completely corrupted pixel. Returning to Figure 4C. if 
step 575 is an:- we red in the affirmative, process control 



moves to step 574 where the faulty pixel's output is 
masked by an interpolated output taken from surround- 
ing pixels. 

[0073] It decision step 575 is answered in :he negative 

5 (i e.. the partially corrupted pixel is not saturated), the 
system generates a corrected output value baseo upon 
tho deviation of tho current pixel's test output from tho 
expected lest output. This is performed with aid of a cor- 
rection model at a step 576. Note that the information 

J0 for the correction model could be obtained at sleps 
506-514 of process 500 depicted in Figure 4A. Note also 
that tho output values of surrounding uncorrupted pixels 
may be used together with this deviation information lo 
obtain the corrected output value at step 576. After step 

'5 576 is completed, the process is finished at 57t?. 

[0074] Most simply, correction may involve adjusting 
the output of the partially corrected pixel by a tixed 
amount oi percentage. For example, an electronic test 
may indicate that a pixel is 30% brighter than appiopn- 

20 ale. The correction may simply involve decreasing the 
irtensity ol the pixel by an appropriate percentage in 
producing the image. Or an optical lest may indicate that 
a pixel is 20% darker than appropriate. In this case, the 
correction may require increasing the intensity of the 

25 pixel by an appropriate amount in producing the image. 
[0075] Generally, all necessary correction information 
will be stored in memory 26. The correction information 
will model the behavior of Ihe partially corruplod pixel 
so that the appropriate correction factor or addond is 

30 p-ovided lor the current operating conditions. Thus 
memory may have to store correction information for 
various conditions. Relevant conditions/parameters in- 
clude operating temperature of tho array, time of expo- 
sure to radiation, and Ihe tike. 

3$ [0076] Ihe CMOS imagers of this invention may be 
deployed in various systems for military, scientific, busi- 
ness, and home applications. For example, they may be 
used in digital cameras, video recorders, night driving 
displays, etc. Generally, the systems will include, in ad- 

M dilion to the CMOS imager chip, optics to capture an 
image and direct it onto the CMOS array. This may in- 
clude one or more lenses, fillers, etc of the types con- 
ventionally employed in image capture systems The 
optics and CMOS imager will be moun'.cd in a casing 

4 $ such as a camera case. Further, the system may include 
a memory for temporarily storing captured images for 
later downloading to a display system. In some instanc- 
es, the display system itself will form part of tho ovcmll 
imager system. 

5o [0077] Although the foregoing invention has been de- 
scribed in some detail tor purposes of clarity of under- 
standing, it will be apparent that certain changes and 
modifications may be practiced within the scope of Ihe 
appended claims. For example, while the specification 

55 has described cerlain pixel and chip architectures which 
accomplish the objectives of tho present invention, 
many others which will be understood by those ol skill 
in the art From the present disclosure to be within Ihe 
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spirit of the present invention may equally be used. For 
example, while the specification has exemplified a pas- 
sive pixel, other pixel types such as active pixels (of pho- 
todiode or photogate type) containing on-pixel amplifi- 
ers also could benefit from use with the invention. In ad- 
dition, the broad fault correction methods of this inven- 
tion could prolitably find use in non-CMOS technologies 
such as CCD technology, but the various system fea- 
tures might have to be implemented on separate chips. 
Therefore, the present embodiments are to be consid- 
ered as illustrative and not restrictive, and the invention 
is not to be lirritod to the details given herein, but may 
bo modified within the scope of the appended claims. 



Claims 

1 . A method of masking faulty pixels in an imager, the 
method comprising: 

(a) exposing the imager to radiation; 

(b) identifying a faulty pixel in the imager; 

(c) determining outputs of a plurality of other 
pixels located about the faulty pixel; and 

(d) masking an output of the faulty pixel using 
the outputs of the plurality of other pixels, 
whereby a masked output of the faulty pixel can 
bo provided in an imago produced by the imag- 
er. 

2. The method of claim 1 , further comprising: 

(e) producing an image from outputs ol a plu- 
rality uf pixels in the imager, wherein the image 
induces the masked output ot the faulty pixel. 

3. The method of claim 1 wherein identifying the faulty 
pixel comprises accessing memory associated with 
the imago- to determine the locating of the faulty 
pixel in the imager, and/or wherein masking the out- 
put oHhe laully pixel comprises replacing the output 
of the faulty pixel with an output value based exclu- 
sively on an output of multiple pixels surrounding 
the at lca:;l one laully pixel. 

4. The method of claim 3. wherein replacing said out- 
put of the laulty pixel comprises providing the faulty 
pixel with .jn output value obtained by interpolating 
output values of at least two pixels surrounding the 
at (Bast one faulty pixol. 

5. The method of cfaim 1 further comprising convert- 
ing the outputs ol pixels in Ihe imager from an ana- 
log foriTici; to a digital format prior to producing an 
image, and/or further comprising, before exposing 
the imager to radiation, testing a selected pixel from 
the imager to determine whether it is laulty. 



6. The method of claim 1 , wherein pixels ot the imager 
can discriminate between multiple colors and 
wherein the faulty pixel is designated lo delect ra- 
diation ot a first color, and wherein the plurality of 

5 other pixels chosen to mask the output of the faulty 
pixel are all designated to detect radiation of the first 
color 

7. A method of correcting a faulty pixel in an imager. 
to the method comprising: 

(a) exposing the imager to radiation: 

(b) identifying the faully pixel in said imager; 

(c) measuring an output of the faulty pixel; 

is (d) determining whether the faulty pixel is sat- 

urated; and 

(e) correcting the faulty pixel with a pixol cor- 
rection technique specifically adapted for cor- 
recting either a saturated pixel or an unsaturat- 
20 ed pixel, whereby a correctec output of the 

faulty pixel can be provided in an image pro- 
ofed by the imager. 

8. The method of claim 7, wherein when the faulty pix- 
25 el is determined to be saturated, the pixel correction 

technique masks an output of the faulty pixel using 
the outputs of the plurality of other pixels, and 
wherein when the faulty pixel is determined to be 
unsaturated, the pixel correction technique corrects 
30 an output of the faulty pixel by performing an oper- 
ation on said output, said operation comprising in- 
creasing or decreasing the magnitude of said out- 
put. 

35 9. The method of claim 3, wherein masking said output 
of the laulty pixel comprises providing the faulty pix- 
el with an output value obtained by interpolating oul- 
put values of at least two pixels surrounding the at 
leasl one faulty pixel. 

40 

1 0. The method of claim 7, wherein identifying the faulty 
pixel comprises accessing memory associated with 
the imager to determine the location o^ the faulty 
pixol in the imager 

45 

11. The method ol claim 7, further comprising convert- 
ing tho outputs of pixels in the imager from an ana- 
log formal to a digital format prior to producing an 
image, and/or further comprising, before exposing 

so the imager to radiation, testing a selected pixel fio r n 
the imager to determine whether it is laulty 

12. A method of testing a selected pixel to delernine 
whether it is faulty, the method comprising; 

55 

(i) electronically resetting the selected pixel to 
a defined charge; 

(ii) rending the selected pixel's output: and 
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(iii) comparing the selected pixel's output to an 
expected value bsscd upon tho defined charge 
provided to tho selected pixel, whereby if the 
selected pixel's cutput significantly deviates 
from said expected value, designating the se- s 
meted pixel as Inulty. 

13. The method of claim 12. further comprising: 

if the selected pixel's output significantly devi- to 
ates irom the expected value, determining 
whetner the selected pixel is partially or com- 
plexly corruptod. wherein if the selected pixel 
is p&i tidily corrupted pixel, it is to be imaged by 
a first technique during readout and if the se- 
lected pixel is completely corrupted, it is to be 
imaged by a second technique during readout. 



of the faulty pixels. 

18. The imager of claim 17. wherein the one or more 
pixels, the one or more circuit elements, and the 
memory are provided on a single integrated circuit 
chip, and/or wherein Ihe imager is CMOS imngor 
and the one more pixels each comprise a photodi- 
ode diffusion formed in a well and a lap to power oi 
ground also formed in the we:l. 

19. The imager of claim 18, further comprising one or 
more voltago sources capable of delivering a voU- 
age to the pholodiode diffusions of the one or rncro 
pixels, which voltage corresponds to a leset state 
of the pixels and preferably further comprising one 
or more charge integrators capable of measuring 
the pixel outputs. 



14. The method of claim 13, wherein determining 
whether the selected pixel is partially or completely 20 
corruptee" comprises determining how far the se- 
lected pixel's output deviates frcm the expected val- 
ue, such Dial if Ihe selected pixel's oulout deviates 
by moie than a defined amount from the expected 
value deeming the selected pixel to be completely 2s 
corrupleo *nd if the selected pixel's output deviates 

by no morn than n dclined amount from tne expect- 2 1 . 
cd value deeming Ihe selected pixel to be partially 
corrupted 

30 

15. The method oi claim 1 3. wherein the first correction 
technique comprises adjusting the output of the se- 
lected pixDl and wherein the second correction 
lechniquo comprises i eplacing the output of the se- 
lected pixel with an average of the outputs of pixels as 
located about the selected pixel. 

16. The method of claim 1 2, further comprising: 

il the selected pixel is found to be faulty, storing 
its location in memory and/or further compris- 
ing: 

exposing the selected pixel ton defined amount 
of tci.l radiation, after electronically resetting 
the selected pixel and prior to reading the se- *S 
lecteci pixel's output. 

17. An image comprising 



20. The imager of claim 17, further comprising an ana- 
log-to-digital converter capable of receiving analog 
outputs from said one or more pixels, converting the 
analog outputs to digital signals, fjnd providing Ihe 
digital signals to said one or more circuit cicrncnls 
such thai the one or more circuit elements can iden- 
tity faulty pixels. 



A system for producing an image of an object, the 
system comprising: 

(a) an imager comprising, 

(i) one or more pixels capable of providing 
outputs indicative of a quantity or a type or 
both the quantity and type ol radiation to 
which each of the one or more pixels has 
been exposed; 

(ii) one or more circuit elements electrically 
coupled to ihe one or more pixels and con- 
figured to mask or correct faulty pixels in 
the imager; and 

(iii) a memory configured to store the loca- 
tions of the faulty pixels, wherein the one 
or more pixels, the one or more circuit ele- 
ments, and tho memory aro provided on a 
single integrated circuit chip: and 

(h) means for outputting an image resulting 
from tho outputs of tho one or moro pixels 



(a) onu or inore pixels capable of providing out- 
puts indicative of a quantity or a type or both 
tho quantity and type of radiation to which each 
of the one or more pixels has been exposed: 

(b) cno 01 more circuit elements electrically 
couplud to Ihe one or more pixels ana config- 
ured lo mas* or correct faulty pixels in tho im- 
ager: and 

(c) a memory configured to store the locations 



22. The system of claim 21, wherein the image output 
by the means for outputting is a photograph and 
wherein the means for outputting is a display. 

23. The system of claim 21. wherein the imager is a 
CMOS imager and the one or more pixels each 
comprise a pholodiode diffusion formed in a well 
and a lap to power or ground also termed in the well 
wherein the imager further comprises an annlog-to- 
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digital converter capable of receiving analog out- 
puts trom said one or moro pixels, convoking the 
analog outputs lo digital signals, and providing the 
digital signals to said one or more circuit elements 
such that ihe one or more circuit elements can iden- $ 
tify faulty mxels. 

24. The system of claim 21, or the imager of claim 17, 
wherein a plurality of the one or more pixels is ar- 
ranged in an array such lhat each of the pixels in io 
said plurality of pixels is separately addressable. 

25. The system of claim 2 1 , or the imager of claim 1 7, 
wherein the one or more pixels are selected from 
the group consisting of active pixels and passive is 
pixels. 
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